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1 Introduction 

We extend the setup in ]!]] to deal with the case in which more than one steady state may exist in 
feedback configurations. This provides a foundation for the analysis of multi-stability and hysteresis 
behavior in high dimensional feedback systems. 

We do not repeat here most of the basic definitions and notations from [jy, save for the reminder 
that, with respect to appropriate positivity cones, we say that a system is monotone if: 

£l h & & Ul >Z U2 x(t,£i,ui) >z x(t, £2,1*2) Vi > 0. 

If int(K) ^ 0, this is equivalent to asking: 

£1 > £2 & u\ y u 2 => x(t,£i,ui) > x(t, £2,1*2) Vt > 

(a set which is the closure of its interior is invariant iff its interior is invariant). We also recall the 
following definition: a system is strongly monotone if: 

£l ^ £2 & ui y u 2 ^> x(t,£i,ui) y?> x(t,£ 2 ,U2) Vi>0. 

It is often convenient to assume more about the steady-state convergence properties of a monotone 
system. The following notion, first introduced in M, will be useful in order to state our main result. 



Definition 1.1 We say that a system admits a non-degenerate I/S static characteristic k x {-) :U^X 
if for all constant inputs u G U there exists a unique globally asymptotically stable equilibrium k x (u) 
imddet(D x f(k x (u),u))^0. □ 

Notice that, for technical reasons, the property has been strengthened with respect to the definition 
in O by assuming non-degeneracy of the equilibria. 



2 Sufficient Conditions for Strong Monotonicity 

Detecting if a system is monotone with respect to the partial order induced by some positivity cone 
K, without actually having to compute explicit trajectories of the system itself, is of course a very 
important task in order to apply our results in any specific situation. Necessary and sufficient differential 
characterizations of monotonicity are discussed in [fiL where extensions to systems with inputs and 
outputs are presented of some well-known criteria previously only formulated for autonomous differential 
equations (see [0]). For the sake of completeness we recall the differential characterization proved in 
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Theorem 1 A finite- dimensional nonlinear systems of differential equations x = f(x,u) with state- 
space X and input-space U is monotone with respect to the positivity cone K and K u for inputs if and 
only if: 

x\ y x 2 and u\ y u 2 f(xi,Ui) - f(x 2 ,u 2 ) G TC(K Xl _ X2 ) (1) 



For the special case of positivity orthants, criteria are better formulated in terms of the incidence graph 

(2) 



of the system. Along similar lines as in [1C], given a system: 

x = f{x,u) 



V = h(x) 

with x G X C R n , u 6 U C M m and h(-) : X — > y C M p , we associate to it a signed digraph, with 
vertices x±, x 2 ■ ■ ■ x n , u\, u 2 , ■ ■ ■ u m , yi, y 2 . . . y n and edges constructed according to the following set of 
rules: 

Edges between x vertices: 

The graph is defined only for systems so that for any couple 1 < i,j < n of integers with i ^ j one of 
the following rules apply: 



1. If f l (x,u) is strictly increasing with respect to Xj for all x,u E X x IA then we draw a positive 
edge eij directed from vertex Xj to X{. 

2. If f l (x,u) is strictly decreasing as a function of Xj for all x,u E X x U then we draw a negative 
edge eij directed from vertex vj to 

3. Otherwise, = for all x, u and no edge from Xj to Xi is drawn. 
Edges between u and x vertices: 

The graph is defined only for systems so that for any couple of integers i, j with 1 < i < n and 1 < j < m 
one of the following rules apply: 



1. If f l (x,u) is strictly increasing as a function of Uj for all x,u £ X x IA then we draw a positive 
edge eij directed from vertex Uj to Xj. 

2. If f l (x,u) is strictly decreasing as a function of Uj for all x,u £ X x IA then we draw a negative 
edge eij directed from vertex it,- to Xj. 

3. Otherwise = for all x, u and no edge from itj to x\ is drawn. 
Edges between x and y vertices: 

The graph is defined only for systems so that for any couple of integers i, j with 1 < i < p and 1 < j < n 
one of the following rules apply: 



1. If h l (x) is strictly increasing as a function of Xj for all x S X then we draw a positive edge e^ 
directed from vertex Xj to y^. 

2. If h l {x) is strictly decreasing as a function of Xj for all x € X then we draw a negative edge e~ij 
directed from vertex Xj to yi. 



9 



3. Otherwise, -g^- = for all x G X and no edge from Xj to is drawn. 

Under this convention, a directed path V is a finite sequence of vertices, v no ,v ni . . . v nL , such that each 
vertex appears at most once in the sequence and is an edge whenever Vi , Vj appear consecutively in 
the path. The integer L, is called the length of the path and it is denoted by L(V). By Vi-, we denote 
the v n ., the i + 1-th, vertex of the path V. A cycle, not necessarily directed, is a finite sequence of 
vertices v no , v ni . . . v nL such that v no = v nL and the constraint that either ejj or eji is an edge whenever 
Vi and Vj appear consecutively in the cycle. The sign of a cycle is the product of the signs of the edges 
comprising it (accordingly the sign of a path is the product of the signs of its edges). One of the main 
results in is that an autonomous system (no inputs) is monotone with respect to some orthant if 
and only if its associated graph does not contain any negative (simple) cycles. An analogous result 
holds for controlled systems: 

Proposition 2.1 A system (^) which admits an incidence graph according to the above set of rules 
is monotone with respect to some orthants K, K u and if and only its graph does not contain any 
negative (simple) cycles. □ 



Remark 2.2 We remark that in this set-up we deliberately restricted the class of systems for which 
the incidence graph is defined. In [1C] in fact the milder requirement that > for all x together 

with > o for some x is asked for in order to draw an edge between vertices Xi, xj. This more general 
notion of incidence graph is however much more cumbersome to deal with if we want to give conditions 
for strong monotonicity of a system. □ 



This definition of incidence graph also provides the right set-up for easy geometrical characterizations 
of the property defined below (see || for the linear systems case). 

Definition 2.3 A MIMO system is (weakly) excitable if for any initial condition £ and any couple of 
inputs v,u with v(t) y u(t) (v(t) u(t)) for almost all t > 0, the following holds: 

x(t,£,v) »z(t,f,it) Vt>0. (3) 

□ 



It turns out that this property can be easily characterized in terms of the incidence graph (see fll^l ): 

Theorem 2 A monotone system which admits an incidence graph is (weakly) excitable provided that 
each Xi is reachable through a directed path from any (some) Uj. 

It is worth pointing out that for the case of positive linear systems the above conditions are necessary 
and sufficient (see ||). 

The proof of this result is based on the following simple Lemma: 

Lemma 2.4 A scalar monotone system x = f(x,u) admitting an incidence graph is (weakly) excitable 
if and only if, for all (for some) j, f(x,u) is strictly monotone as a function of Uj. 

Proof. Consider, without loss of generality, the case of a system monotone with respect to the standard 
positive orthants. Let v(t) y u(t) be arbitrary input signals. In particular, there exists an integer- 
valued function of time j(t) so that Vju\(t) > Uju\(t) for almost all t > 0. By monotonicity we know 
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that x(t,^,v) > x(t,£,u) for all t > 0. We need to show that the inequality is strict for all t > 0. 
Assume by contradiction^ that x(t, £, u) = x(t, £, u) := x(t) for all t E (0, e) for some e > 0. Then taking 
derivatives with respect to time we have, f(x(t),v(t)) = f(x(t),u(t)) for almost all t € (0, e) but this 
contradicts strict monotonicity of f(x,u) with respect to all of the UjS. 

Conversely let the system admit an incidence graph. Hence, f(x,u) is either strictly monotone with 
respect to uj or (x , u) = for all Assume by contradiction that there exists q£ (x, u) = 

for some j. Then, given any initial condition £, and any couple of feasible input values u, v so that 
v — u = \v — u\ ej, we have: x(t, £, v) = x(t, £, u), for all t > 0, as the j-th component of the input does 
not influence the solution of the differential equation. But this contradicts excitability. 

Similar arguments apply to the case of weak excitability. We give the sketch of the proof below: 
Consider arbitrary input signals v and u so that v(t) ^> u(t) for almost all t > 0. By monotonicity 
x(t, £, v) > x(t, £, u) for all t > 0. Hence, we only need to show that the inequality is strict for all 
t > 0. Assume by contradiction x(t,^,v) = x(t,£,u) := x(t) for all t G (0,e) for some e > 0. Then 
taking derivatives with respect to time we have, f(x(t),v(t)) = f(x(t),u(t)) for all t € (0,e) but this 
contradicts strict monotonicity of f(x,u) with respect to at least some of the UjS. 

The converse implication is trivial as J^j- = for all j implies that solutions do not depend upon 
input signals, and this clearly violates weak excitability. I 

Theorem || can be proved by induction by applying repeatedly Lemma (see appendix for a 
detailed proof). 

The dual of excitability is also useful in the following discussion: 

Definition 2.5 A system is (weakly) transparent if for each pair of solution x(t,£i,u), x(t,^2,u) with 
6 >- £2 we have h(x(t,£i,u)) » (y)h(x(t, £ 2 , u)) for all t > 0. □ 

Theorem 3 A monotone system which admits an incidence graph is (weakly) transparent provided that 
directed paths exist from any Xj to any ( at least one ) output vertex yi . 

The proof of Theorem || is given in an Appendix. In the present section we discuss a sufficient 
condition for strong monotonicity of MIMO systems in unitary feedback. 

Theorem 4 Consider the unitary feedback interconnection of a MIMO system: 

x = f(x,u) 

V = Hx) W 

viz. the differential equation resulting from fy) when we let u = y. The induced flow is strongly monotone 
provided that M) be monotone, excitable and transparent with either excitability or transparency possibly 
holding in a weak sense. 

Proof. By Theorem [l], we know that 

xi y x 2 & u\ > u 2 => f(x 1 ,u 1 ) - f{x 2 ,u 2 ) G TC Xl - X2 (K) (5) 

where K is the positivity cone relative to the order y. Let us first show monotonicity of the feedback 
loop system. Recall that h is a monotone map, viz.: 

x\ y x 2 =^> h(xi) > h(x 2 ) (6) 
1 We exploit the fact that the interior of the positivity cone is invariant 
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Therefore, if we combine (||) with (0) and we let u% = h(x\) and 112 = h[x-2) we obtain 

xi h x 2 f(xi, h{ Xl )) - f(x 2 , Kx2)) G TC X ^ X2 {K) (7) 
which, by Theorem 1 in GJ is equivalent to monotonicity of the closed-loop system: 

z = f(z,h(z)). (8) 
In particular then, if we denote by z(t, £) the solutions of @ we have as a consequence of monotonicity: 

eih£2 =j-^(Ui))>M46)) v *>°- (9) 

Exploiting the fact that £) = x(i, £, /i(z(i, £))) and (weak) strong transparency of (Q) we obtain: 
£1 ^ £2 fc(*(t, £1)) = £1, 6)))) » M fc(x(t, 6, h(z{t, a)))) 

b 60))) = &(*(*>&)) vt>o. (10) 

Finally, by weak (strong) excitability and (|1C|) 

=> 2(t,c 1 ) = x(t,£i,/ l (z(t,£i)))»x(t,6,M^6))) = ^(t,6) vt>o (11) 

as desired. I 



3 Monotone Linear Systems 

We recall next some basic facts about linear monotone systems which will be of interest in the discussion 
of the main result. 

Theorem 5 Let us consider the following finite dimensional MIMO linear system: 

x = Ax + Bu, y = Cx. (12) 

with x G (1™,^), u G (R m ,^ u ), y G (W, y y ) (viz. we assume the state, input and output space 
equipped with some partial orders induced by the positivity cones K x , K u and K? respectively) . 



System (li) is a monotone control systems with respect to the partial orders specified above if and 
only if: 

1. K is positively invariant for the autonomous system x = Ax; 

2. BK U C K x ; 

3. CK X C K y . 

Proof. By the characterization of monotonicity in Theorem |], a system is monotone if and only if: 

xi hx x 2 & u\ hu u 2 => A(x\ — X2) + B(u\ — U2) G TC Xl - X2 (K x ), (13) 
and the output map is monotone, viz.: 

x\ y x 2 Cx\ y Cx2- (14) 



In terms of positivity cones and denoting x := x\ — x<i and u = u% — U2, conditions (13) and ( |i~4| ) are 
equivalent to: 

xeK x kueK u Ax + BHeTCx(K x ) (15) 

and: 

x G K X =^ Cx G K y . (16) 

Condition ( |l3|) is clearly equivalent to assumption 3). Condition (|l5|) can be further decomposed by 
first taking arbitrary x and fixing u = and then x = and arbitrary u. Condition (|l^) therefore 
implies (and is in fact equivalent to as we shall see later): 

x G K x => Ax G TC- X (K X ) (17) 

and: 

iiGi( U => Btt G TC (K X ) = K x . (18) 

The converse implication just follows by recalling that tangent cones of a convex set are closed under 
sums (since they are convex cones) and the following inclusion holds: K x C TCx{K x ) for any x G K x . 
Condition (|l8| ) is clearly assumption 2). Whereas condition (|i~7| ) is the well-known characterization of 
positive invariance of K x under the flow x = Ax. I 



Corollary 3.1 The impulse response of a finite-dimensional, monotone, linear system (with respect to 
positive impulses) is a positive signal in output space: 

Ce At BK u C K y 



□ 



The following fact is a straightforward consequence of the Perron-Frobenius (Krein-Rutman) Theo- 
rem (see [|j pp. 6-8): 

Theorem 6 Assume that the linear system x = Ax admits a positively invariant convex (and proper) 
cone K. Then, there exists a dominant real eigenvalue A (viz. an eigenvalue so that Re[\i\ < A for all 
i G 1, 2, ... n), and the corresponding positive eigenvector v\ (unique up to a positive multiple) satisfies 
v x G K. 



Proof. Consider the exponential map £ — > e At ^. By positive invariance of K, for each t > the 
exponential is a linear map from K to K. Moreover, for t sufficiently small it is one-to-one on the 
spectrum of A. Thus, by Lemma A. 3. 3 in [14], the geometric multiplicity of e Xit as an eigenvalue of 
the exponential map is the same as A« as an eigenvalue of A. Therefore, we can study the spectrum of 
A by looking at the spectrum of its exponential map for t sufficiently small. By the Perron-Frobenius 
Theorem, there exists a real positive eigenvalue fj,, with eigenvector v G K, which is dominant in the 
sense that /i = p(e At ) (eigenvalue of maximum modulus). Therefore, we conclude that A := log(/i)/£ is 
an eigenvalue for A, relative to the same eigenvector v G K, and Re(A) > Re(Aj) for all A« G Spec(A). I 



Remark 3.2 It is worth pointing out that for asymptotically stable SISO monotone systems, the 
condition h(t) > 0, implies that the C°° — > C°° induced gain, equals the steady state gain. Recall that 
the steady-state gain of a linear system is just the slope of its I/O static characteristic. The — > 
induced gain is instead defined as: 

\\y\\oo 

7oo := sup 

u^O \\ u \\co 



where y(t) = y(t,0,u). It is well known (see (5|) that equals the L\ norm of the impulse response. 
Thus, 



/■+oo r+oo 

/ \h(t)\ dt= h{t) dt = -CA- l B = k'Ju). 
Jo Jo 



□ 



The next technical lemma will be useful in order to study nonlinear monotone systems by linearizing 
the flow around an equilibrium position: 

Lemma 3.3 Let / : X x U — > W 1 be a C 1 vector-field. Let f(x, u) = for some x G X and u G U. If 
the flow induced by / is monotone with respect to some positivity cone K, the same holds true for the 
linearization at (x,u): 



z 
w 



dx 
dh 



x=x,u=u 
_ Z 



df 
da 



x=x,u=u 



(19) 



Proof. By one the results in [[jj, a system is monotone with respect to the positivity cones K (for states) 
and K u (for inputs) if and only if: 



xi y x 2 , uihu 2 ^ f(xi,m) - f(x 2 ,u 2 ) G TC Xl - X2 (K). 

Let z G K, v € K u be arbitrary and, for any e > 0, x e := ez + x, u £ = sv + u. By 
x\ = x £ and X2 = x, 

f(x £ ,u £ )/eeTC £z (K) = TC z (K). 
By letting e tend to and exploiting closedness of the tangent cone we have: 



z h 0, v y 



5/ 

5x 



5/ 

9n 



v e rc,(K). 



(20) 

applied with 
(21) 

(22) 



Let, for simplicity A = ^J- 



x=x,u=u 



and B = §£ 



. By linearity, there follows easily: 

t 

«i >= z 2 , vi >r t> 2 (Asi + Svi) - (^z 2 + ^2 ) G TC Zl - Z2 (K). (23) 
This concludes the proof of the claim, by exploiting once more the characterization of monotonicity in 



Lemma 3.4 Consider a monotone system with a non-degenerate I/S static characteristic k x (-). For 
each n 6W the corresponding equilibrium k x (u) is hyperbolic. 



Proof. By Lemma 3.3 the linearized system at the equilibrium is monotone. Therefore it admits a real 



dominant eigenvalue A. By asymptotic stability of the nonlinear system and non-degeneracy, A < 0. 
Thus for all Aj G sp[D x f(k x (u),u)] we have Re[Aj] < A < which completes the proof of our claim. I 

We remark that for the special case of K, K u being positive orthants the result was already proved 
in Section 8, fpJl . 
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4 Main Result 



Our main result will provide a global analysis tool for positive unitary feedback interconnection of 
monotone systems. The fixed points of the I/O characteristic will play a central role in the statement 
of the result. In particular, we say that k y (-) : U — > y has non-degenerate fixed points if for all u £ U 
with k y (u) = u we have that k' y (u) exists and k' y {u) ^ 1. 

Theorem 7 Consider a strongly monotone, SISO, dynamical system, endowed with a non- degenerate 
I/S and I/O static characteristic: 

x = f(xu) 
y = h{x), 

where f is of class C . Consider the unitary positive feedback interconnection u = y. Then the equilibria 
are in 1-1 correspondence with the fixed points of the I/O characteristic. Moreover, if k y has non- 
degenerate fixed points, and all trajectories are bounded, then for almost all initial conditions, solutions 
converge to the set of equilibria of $2) corresponding to inputs for which k, ' (u) < 1. 



Proof. Let k x — > X denote the I/S static characteristic and u any solution of u = h(k x (u)). Clearly, 
f(k x (u),h(k x (u))) = f(k x (u),u) = and therefore x := k x (u) is an equilibrium of the closed-loop 
system. Conversely, let x be an equilibrium; the corresponding output value satisfies y = h(x). As in 
closed-loop u = y, we have x = k x (y). Thus y = h(k x (y)), as desired. We verify next that the C°° 
induced gain of the linearized system (|l9|), satisfies: 



In fact, we have: 



7oo = k' y (u). 
dh 

k' y (u) = *£(«)• (25) 

Recalling that, by definition, f(k x (u),u) = 0, we can compute the derivative of k x by differentiating: 

df df 

^-(k x {u),u) k' x {u) + -±(k x {u),u) = (26) 



(at those points where the derivative exist). Evaluating the above expression at u = u yields k' x {u) = 
—A^ 1 B, where A and B are defined as A = ^ and B = S£ and A -1 exists 

x=k x (u),u=u x =k x ( u),u=u 

by non-degeneracy of the I/S characteristic. The claim follows by Remark ^2, Next we investigate 
stability of the linearized system by looking at the slopes of the I/O characteristics at the equilibria. 

We now make some remarks concerning the closed-loop linearized system, viz. the system arising by 
linearizing the nonlinear system fl24| ) together with the unitary feedback interconnection u = y (this is 
actually the same system resulting by first linearizing (|24] ) and then applying unitary feedback). This 
system satisfies the equations i = (A + BC)z with the notations introduced so far. Moreover, it is 
monotone by virtue of Lemma |3.3| . Therefore, it admits a real dominant eigenvalue A, viz. an eigenvalue 
so that A > Re [A»] for all % = 1, 2, . . . n and v £ K for a corresponding eigenvector: {A + BC)v = Xv. If 
we multiply both sides of the equality times CA' 1 we obtain: 

A {CA~ l v) = (Cv) [1 + CA- X B] = (Cv) [1 - k' y {u)] (27) 

Moreover, by the asymptotic stability assumption on A: 

r+oo 

CA- l v = - I Ce^v dt < 0, (28) 



o 



8 



where the integral in ( p8| ) converges as A is Hurwitz by virtue of Lemma 3.4. 

Thus A < if and only if k' y {u) < 1. On the other hand, k' y (u) > 1 iff A > 0. In particular, equilibria 
with k' y {u) < 1 are locally asymptotically stable and equilibria with k' y (u) > 1 have a nontrivial unstable 
manifolds. It is a routine exercise in measure theory to prove that the set of initial conditions which 
result in a converging trajectory is indeed a Borel set. Therefore, by Hirsch's Theorem on generic 
convergence of strongly monotone flows (see Q, Section 7) for almost all initial conditions, solutions 



will converge to the set of equilibria. Moreover, by Remark (O) the stable manifolds of (exponentially) 
unstable equilibria have zero-measure. Therefore, for almost all initial conditions solutions converge to 
points where k y (u) < 1. This completes the proof of our result. I 

Remark 4.1 It is worth pointing out that, whenever the equilibrium in Theorem is unique, conver- 
gence to the equilibrium is global under mild approximability assumptions which are always satisfied, 



for instance, if the state-space is convex. This is proved in Theorem 3.1 of [13]. □ 



Remark 4.2 An alternative proof, based on frequency domain considerations, of the connection be- 
tween stability of the closed- loop equilibrium and the I/O characteristic is provided next. 

Consider the transfer function 

/•oo 

w (s) = I h{t)e- st dt 

of a strictly proper system, and let 



o 



w{s) 



1 — w(s) 

be the transfer function of the associated unity-feedback closed-loop system. Suppose: 

1. h is integrable (so, w has no real nonnegative poles); 

2. h{t) > for all t > (and is not identically zero); 

3. w(0) 7^ (transversality condition). 

Then: 

(a) there exists a positive real pole of w c \ if and only if w(0) > 1; 

(b) every real pole of w c \ is negative if and only if w(0) < 1. 

Proof: 

By the first assumption, w (A) is a continuous (real- valued) function for A > 0. 

Furthermore, h(t) > for all i > implies that w'(X) = - / °° h(t)te~ xt dt < for all A, so w is a 
strictly decreasing function of A. 

Positive real poles of w c \ are exactly those A > such that u>(A) = 1. 

If w{X) = 1 for some A > then the strict decrease of w implies that w(0) > 1. Conversely, suppose 
that w(0) > 1. By strict properness, w(X) — > as A — > +oo. Thus there is some A > such that 
w(X) = 1. This proves (a). 

The first conclusion may be restated as: "every pole of w c \ is < if and only if u>(0) < 1" so, since we 
know in addition that w(0) ^ 1, this is the same as requiring that every real pole is (strictly) negative. 
Thus (b) holds too. 

□ 



Remark 4.3 Stable manifolds of (exponentially) unstable equilibria have zero-measure. In the non- 
necessarily hyperbolic case, this fact is an easy consequence of Theorem 2.1 in Q (modified as discussed 
in the remarks following Theorem 2.1, including the choice of suitable norms and the multiplication by 
a "bump" function, after a linear change of coordinates, and specialized to r = 1, and applied to time-1 
maps). □ 

Remark 4.4 A precise characterization of the basin of attraction of each asymptotically stable equi- 
librium is of course not possible in general; on the other hand, it is a straightforward consequence of 
monotonicity of the I/S characteristic that equilibria are ordered, e\ -< &2 -< 63. It therefore makes sense 
to speak about intervals [ei,e2] := {x 6 X : e\ ■< x < e2j-. Again, it is a straightforward consequence 
of monotonicity that intervals [ei,e2] with e\, e2 equilibria are positively invariant. This allows to give 
estimates of the basin of attraction of each equilibrium. In the case of 3 equilibria for instance, with 
ei -< &2 -< 63 and e±, asymptotically stable, e2 unstable, we can conclude that {x : x <C 62} C A\ and 
{x : x ^> 62} C ^3. Similar considerations, based on empirical evidence, are made for instance in 
It is therein pointed-out how the unstable equilibrium plays the role of a threshold. □ 



5 Applications 

A typical situation for the application of Theorem [?] is when a monotone system with a well-defined 
I/O characteristic of sigmoidal shape is closed under unitary feedback. If the sigmoidal function is 
sufficiently steep, this configuration is known to yield 3 equilibria, 2 stable and 1 unstable. In biological 
examples this might arise when a feedback loop comprising any number of positive interactions and an 
even number of inhibitions is present (no inhibition at all is also a situation which might lead to the 
same type of behavior). This is a well-known principle in biology. One of its simplest manifestations is 
the so called "competitive exclusion" principle, in which two competing species are coexisting and the 
possible equilibria are those where either one of the species is strongly inhibited. Just as an example 
consider the system described in || 11], describing the synthesis of lactose operon in Escherichia coli.. 



The systems equations follows: 



Xl 
X2 



Xl 
X2 



(29) 



This can be seen as the unitary feedback interconnection of: 



Xl 

x 2 



- X2 



(30) 



y 



x 2 . 



Equation ( |30[) is a monotone dynamical system with respect to the order induced by the positivity cone 
K := M<o x M>o- It is straightforward by a cascade argument to see that the system is endowed with 
the following static I/S characteristic: 



k x (u) 



In Fig. |l] we plotted the I/O static characteristic for ai = 1.3, «2 = 1, /3 = 3 and 7 = 10. As confirmed 
by simulations (see Phase plane), for almost all initial conditions trajectories converge to the equilibria 
where the derivative condition is satisfied. Of course, the interest of our results is in the high-dimensional 
case in which phase-plane techniques cannot provide the result. 



in 



Figure 1: (a) I/O static characteristic; (b) Phase plane diagram 



6 External Stimuli, Thresholds and Hysteresis 



Throughout this section we investigate the behavior of positive feedback interconnections of monotone 
systems which are in turn excited by some exogenous input. In particular we consider interconnections 
of the following type: 

x = f(x,u,v) 

V = h y( x ) ( 31 ) 
w = h w (x) 

along with the unitary feedback interconnection u = y. The block diagram of such systems is shown in 
Fig. | 




Figure 2: Block diagram of unitary feedback system with external inputs 



We assume / :Ix[/xF-> W 1 to be a locally Lipschitz function and that the system (31) is a 
monotone control system with input [u, v] and output [y, w] with respect to some ordering y x of the 
state-space X and cross-product orders as far as inputs [u, v] and outputs [y, w] are concerned, (viz. 
[u\,vi] hi [u 2 ,v 2 ] iff tii hu u 2 and v\ hv v 2 , [yi,wi] ho [2/2,^2] iff V\ h y m an d m hw w 2 )- 
For each fixed value of the input v, systems as in (|3l|) can be studied according to the techniques 
described previously. A special instance of systems of this kind is given by SISO systems of the following 
form: 

x = f(x,d) 

d = g(v,y) (32) 

y = h(x) 
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where g:Fx[/^lisa monotone and locally Lipschitz function, (for instance u, v G M>o and 
g(v,y) = vy or g(v,y) = v + y ). This structure ( see Fig. |||) is of interest because it arises commonly 
in biological applications and is particularly suited for a graphical analysis. 
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Figure 3: A special feedback configuration of SISO systems 



Next, we discuss the behavior of such interconnections in the presence of external stimuli. In 
particular, in the case of multistable systems we prove the existence of threshold values of inputs which 
trigger the commutation between different equilibria. 

The above considerations suggest the possibility of studying interconnections as in (^Tj) by taking into 
account a parameterized family of I/O static characteristics in the (u, y) plane, where the parameter 
is the exogenous input v. This type of analysis is very general and bifurcations can be traced by 
looking at the intersections of the parameterized I/O characteristic with the diagonal u = y. For the 
special structure (||) instead, the study can be carried out in the (d, y)-plane allowing some intuitive 
simplifications. A single I/O characteristic is needed in fact, from d to y, and equilibria correspond 
to intersections with the "parameterized" family of functions d = g(v,y), which also takes values in 
the (d, y) plane. Although the analysis which follows is essentially a consequence of Theorem 0, it is 
still worth pursuing, because it provides a solid theoretical justification to phenomena which are well 
described and understood in many biological applications. Consider again the system (^), subject to 
the feedback interconnection u = v ■ y. This results in the following set of equations: 

= i+iv^y 1 ~ Xl 

* 2 = ^k~ X2 (33) 



y = x 2 . 

We may therefore analyze the system by looking at the I/O static characteristic from u to y, together 
with the u-parameterized family of lines y = u/v. Fig. || illustrates a typical situation, corresponding 
here to the parameters value in the following table: 
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Notice that for v = 1 bistability is obtained; in particular two equilibria are asymptotically stable and 
one is an unstable saddle whose stable manifold behaves as a separatrix for the basins of attractions 
of the stable equilibria. Bifurcations occur at two different values of v, approximately vi ~ 0.8 and 
V2 ~ 1.35. This values correspond to the slopes of the tangent lines to the I/O characteristic. For all 
v > V2 in fact there only exists one equilibrium, usually referred to as the activated equilibrium. For 
v < v i again only one equilibrium occurs but corresponding to a non-activated state. These values play 
therefore the role of input thresholds that may trigger transition from the non-activated state to an 
activated one and vice versa. After a signal of amplitude bigger than v 2 is applied for a sufficiently 
long time, the state will be in proximity of the activated equilibria. Then, this level of output will be 
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maintained even after v(t) drops below V2, provided that v\ < v(t). Further decrease of the v(t) below 
Vi, for a sufficiently long time, will instead trigger transition to a deactivated state, which is afterward 
maintained also for higher values of v(t), provided that v(t) < v%. This kind of behavior, known as 
hysteresis, has been observed in many biological systems ( see for instance 0]). These techniques hence 
provide a way of computing threshold values even without knowing explicitly the systems equations 
or parameters, if the function g(-, •) in (|32] ) is known together with the I/O static characteristic. In 
other words many interesting deduction on the behavior of the system are possible only by checking 
(experimentally or in simulations) the static properties of the system. 




Figure 4: Thresholds and hysteresis 



7 Why is Monotonicity Needed ? 

Local analysis techniques based on the study of intersections of static characteristics of interconnected 
systems or, in the two-dimensional case of nullclines, are very common in mathematical biology. Our 
discussion shows that for the class of monotone systems, under relatively mild assumptions, almost 
global convergence results can be obtained and the investigation of the stability property of equilibria 
can be carried out just by graphical inspection at the intersection points of the I/O characteristics of 
systems in feedback. In this section we show by means of an example how monotonicity is a crucial 
assumption in this respect. The following planar system: 

±1 = Xi(-Xi+X 2 ) 

x 2 = 3x 2 (-x 1 + u) (34) 
y = c + b-r^ 2 ^ 

a K+X2 

evolving in K> , it is not monotone. However, it has a well defined (monotonically increasing) I/O static 
characteristic, provided that c,b,k € M>o- Moreover, for certain parameters values, the I/O character- 
istics has 3 (non-degenerate) fixed points. The closed- loop system resulting from the interconnection 
u = y, however, need not be globally converging at the set of equilibria. The simulations in Fig. prefer 
to the following values: c = 1.1,6 = 361/140, k = 405/14. Notice that the 3 equilibria correspond to 2 
unstable foci and one saddle point. 



13 



Figure 5: A stable limit cycle arising in a non- monotone feedback loop and the I/O static characteristic 
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A Graphical characterizations of Transparency and Excitability 

Proof of Theorem |2] Consider a monotone system which admits an incidence graph. Let £ be an 
arbitrary initial condition and u(t), v(t) arbitrary input signals satisfying v(t) ^> u(t) for almost all 
t > 0. Clearly x(t,(,,v) >z x(t,£,u). Hence, we only need to show that inequality is actually strict for 
state components, viz. x(t, £, v ) S> x(t, £, u). The result is proven by induction, by exploiting repeatedly 



Lemma 2.4. To this end it is useful to introduce decompositions of the system in sublayers, based on 



the following notion of distance between vertices of a graph: 

d(v — > w) = mm{L(V) :Vq = v and Vl = w}, (35) 

i.e. d(v, w) denotes the shortest length among paths which link v to w. For each vertex X{ of the 
incidence graph corresponding to one of the state variable we define the integer: 

D(xi) = min d(uj — ► Xi), (36) 

in words, D{xi) corresponds to the minimum distance from some input vertex Uj to the state vertex x^. 
By assumption D(xi) is well-defined for all i € {1, . . . n}. We say that Xi belongs to the z-th sublayer, if 
D(xi) = 1. Consider any state component X{ so that D(xj) = 1 (by assumption such a component always 
exists). Clearly ±i = fi{x,u) can be seen as a scalar (monotone) system, forced by the inputs u and 
Xj^i. As D(xi) = u, there exists j such that / is strictly monotone as a function of Uj and therefore, 
Vj(t) > Uj(t) for almost all t > implies Xi(t,£,v) > Xi(t,£,u) for all t > 0. By induction, any 
component belonging to the i-th sublayer is at least reachable in one step by some component belonging 
to the i — 1-th sublayer, and therefore a similar argument applies, yielding Xi(t,£,v) > Xi(t,£,u) for all 
t > 0. 

This completes the proof for the case of weak excitability. Next we provide a detailed argument for 
the case of excitability. Assume that v(t) >- u(t) for almost all t > 0. Then, there exists an integer j* 
so that {t : Vj(t) > Uj(t)} D [0, e) has non-zero measure for all e > 0. We prove the result by induction 
by considering a sublayer decomposition taken by looking at graph distances with respect to the input 
vertex j*, viz. D(x{) := d(uj* — > Xi). By assumption D(xi) is well-defined for alii G 1,2,... n. Consider 
any state component Xi so that D{xi) = 1 (such a component always exists). Again Xi = fi(x,u) can 
be seen as a scalar (monotone) system, forced by the inputs u and Xj^. In particular fi(x,u) is strictly 
monotone with respect to j*. We want to show that Xi(t, £, v) > Xi(t,£,u) for all t > 0. Assume by 
contradiction Xi{t,^,v) = Xi(t, £, u) := x{t) for all t S [0, e), for some e > 0. Taking derivatives we have 
fi(x(t),v(t)) = fi(x(t),u(t)) for all t £ [0, e), but this contradicts strict monotonicity with respect to 
Uj*. By induction, any component belonging to the i-th sublayer is at least reachable in one step by 
some component belonging to the i — 1-th sublayer, and therefore a similar argument applies, yielding 
Xi(t,^,v) > Xi(t,£,u) for all t > 0. 

Proof of Theorem |3| Consider an arbitrary pair of ordered initial conditions £i >- £2 • By monotonicity 
and unicity of solutions we have x(t,£i,u) >- x(t,^2, u) for all t > 0. As x is finite-dimensional some j* 
exists so that {t : Xj*(t,£i,u) > Xj*(t, £2, u)} H [0, e) has non-zero measure for all e > 0. We claim that 
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Xi(t, £i,u) > Xi{t,^2iU) for all vertex X{ reachable from the Xj* and denote with TZj* the set of such 
X{S. The claim can be shown inductively by arguments analogous to the one employed in the proof of 
Theorem ^. 

By the graph reachability condition, for all (some) output vertices yj there exists at least X{ € TZj* 
so that Xi — ► yj is an edge of the incidence graph. Thus, hj(x(t,£i,u)) > hj(x(t,^2,u)) for all t > for 
all such js. This concludes the proof of the Theorem. 
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